Automatic Web News Content Extraction

The extraction of the main content web pages is widely used in search engines, but a lot irrelevant information, such as advertisements, navigation, and junk included pages. Such information reduces efficiency processing content-based applications. This study aimed to extract using DOM Tree rationality segmentation results based on entropy nodes from Tree. first step this research was classify page tags only processed that affected structure page. second consider features structural node comprehensively. next perform fusion obtain results. Segmentation testing carried out with several different structures so it showed proposed method accurately quickly segmented removed noise content. After formed, would be matched database eliminate Firefly Optimization algorithm. Then, evaluating effectiveness aspect were done detect produce clear documents.